Managing Data Representation For User Equipments In A Communication Session

ABSTRACT

In an embodiment, an application server receives, from a given UE, data that is configured to visually represent physical user input detected at the given UE at a first level of precision. The application server determines data presentation capabilities of a target UE and/or a performance level associated with a connection between the application server and the target UE. The application server selectively transitions the received data from the first level of precision to a second level of precision based on the determination, and transmits the selectively transitioned data to the target UE for presentation. In another embodiment, the application server receives a request to adjust display settings of the target UE from the given UE responsive to detected physical user input. The application server selectively adjusts the target UE&#39;s display settings based on the received request.

BACKGROUND OF THE INVENTION

1. Field of the Invention

Embodiments of the invention relate to managing a representation of dataassociated with a communication session.

2. Description of the Related Art

Wireless communication systems have developed through variousgenerations, including a first-generation analog wireless phone service(1G), a second-generation (2G) digital wireless phone service (includinginterim 2.5G and 2.75G networks) and a third-generation (3G) high speeddata, Internet-capable wireless service. There are presently manydifferent types of wireless communication systems in use, includingCellular and Personal Communications Service (PCS) systems. Examples ofknown cellular systems include the cellular Analog Advanced Mobile PhoneSystem (AMPS), and digital cellular systems based on Code DivisionMultiple Access (CDMA), Frequency Division Multiple Access (FDMA), TimeDivision Multiple Access (TDMA), the Global System for Mobile access(GSM) variation of TDMA, and newer hybrid digital communication systemsusing both TDMA and CDMA technologies.

The method for providing CDMA mobile communications was standardized inthe United States by the Telecommunications IndustryAssociation/Electronic Industries Association in TIA/EIA/IS-95-Aentitled “Mobile Station-Base Station Compatibility Standard forDual-Mode Wideband Spread Spectrum Cellular System,” referred to hereinas IS-95. Combined AMPS & CDMA systems are described in TIA/EIA StandardIS-98. Other communications systems are described in the IMT-2000/UM, orInternational Mobile Telecommunications System 2000/Universal MobileTelecommunications System, standards covering what are referred to aswideband CDMA (W-CDMA), CDMA2000 (such as CDMA2000 1×EV-DO standards,for example) or TD-SCDMA.

In W-CDMA wireless communication systems, user equipments (UEs) receivesignals from fixed position Node Bs (also referred to as cell sites orcells) that support communication links or service within particulargeographic regions adjacent to or surrounding the base stations. Node Bsprovide entry points to an access network (AN) or radio access network(RAN), which is generally a packet data network using standard InternetEngineering Task Force (IETF) based protocols that support methods fordifferentiating traffic based on Quality of Service (QoS) requirements.Therefore, the Node Bs generally interact with UEs through an over theair interface and with the RAN through Internet Protocol (IP) networkdata packets.

In wireless telecommunication systems, Push-to-talk (PTT) capabilitiesare becoming popular with service sectors and consumers. PTT can supporta “dispatch” voice service that operates over standard commercialwireless infrastructures, such as W-CDMA, CDMA, FDMA, TDMA, GSM, etc. Ina dispatch model, communication between endpoints (e.g., UEs) occurswithin virtual groups, wherein the voice of one “talker” is transmittedto one or more “listeners.” A single instance of this type ofcommunication is commonly referred to as a dispatch call, or simply aPTT call. A PTT call is an instantiation of a group, which defines thecharacteristics of a call. A group in essence is defined by a memberlist and associated information, such as group name or groupidentification.

Telepresence refers to a set of technologies which allow a person tofeel as if they were present, to give the appearance of being present.Additionally, users may be given the ability to affect the remotelocation. In this case, the user's position, movements, actions, voicemay be sensed, transmitted and duplicated in the remote location tobring about this effect. Therefore information may be traveling in bothdirections between the user and the remote location. Telepresence viavideo deploys greater technical sophistication and improved fidelity ofboth sight and sound than in traditional videoconferencing.

Technical advancements in mobile communication systems have alsoextended the capabilities of videoconferencing for use with mobiledevices, enabling collaboration independent of location. Differing fromtraditional video telepresence, mobile collaboration utilizes wireless,cellular and broadband technologies enabling effective collaborationindependent of location. Mobile collaboration environment combine theuse of video, audio and on-screen drawing capabilities and using mobiledevices to enable multi-party conferencing in real-time, independent oflocation.

In a telepresence environment, a user can physically show ideas usingtouch points, movements and gestures, which can be communicatedsynchronously on other UEs. The present invention presents a means forscaling and/or representation of data stream in a real-time streamingmobile collaboration environment in accordance to UEs displaycapabilities and bandwidth allocation.

Many different types of UEs exist with different display capabilities.Display capabilities of UEs can vary depending in screen size, colorresolution, frame rate, display resolution, color resolution, and aspectratio. Additionally, display capabilities of UEs can vary depending onprocessor speed, device memory, software application. Alternatively,bandwidth allocation and the performance level of the connection to eachUE can vary. Therefore, allocation for exchanging data stream variesamong different transmitting and receiving UEs depending on each UE'sdisplay capabilities. Embodiments of the invention allow for thedetermination of the display capabilities of each UE, in order toprevent the bandwidth allocation for each UE from being eitherunderutilized or over-utilized. The present invention presents a meansfor determining the capability of each UE and translating the datastream to be transmitted accordingly.

The present invention presents a means for a server to transition thedisplay data stream based on a physical user input for transmission in atelepresence environment. The invention also provides a means fordetermining the data capability of the target UEs and connectionperformance to the target UEs, and for adjusting transmission of thedisplay data accordingly.

SUMMARY

In an embodiment, an application server receives, from a given UE, datathat is configured to visually represent physical user input detected atthe given UE at a first level of precision. The application serverdetermines data presentation capabilities of a target UE and/or aperformance level associated with a connection between the applicationserver and the target UE. The application server selectively transitionsthe received data from the first level of precision to a second level ofprecision based on the determination, and transmits the selectivelytransitioned data to the target UE for presentation. In anotherembodiment, the application server receives a request to adjust displaysettings of the target UE from the given UE responsive to detectedphysical user input. The application server selectively adjusts thetarget UE's display settings based on the received request.

BRIEF DESCRIPTION OF THE DRAWINGS

A more complete appreciation of embodiments of the invention and many ofthe attendant advantages thereof will be readily obtained as the samebecomes better understood by reference to the following detaileddescription when considered in connection with the accompanying drawingswhich are presented solely for illustration and not limitation of theinvention, and in which:

FIG. 1 is a diagram of a wireless network architecture that supportsaccess terminals and access networks in accordance with at least oneembodiment of the invention.

FIG. 2A illustrates the core network of FIG. 1 according to anembodiment of the present invention.

FIG. 2B illustrates the core network of FIG. 1 according to anotherembodiment of the present invention.

FIG. 2C illustrates an example of the wireless communications system ofFIG. 1 in more detail.

FIG. 3 is an illustration of a user equipment (UE) in accordance with atleast one embodiment of the invention.

FIG. 4 illustrates a communication device that includes logic configuredto receive and/or transmit information.

FIG. 5 illustrates a process of exchanging data representative ofphysical user input during a group communication in accordance with anembodiment of the present invention.

FIG. 6 illustrates a communication flow that is based upon an executionof the process of FIG. 5 in accordance with an embodiment of theinvention.

FIG. 7A illustrates an example implementation of the process of FIG. 5in accordance with an embodiment of the invention.

FIG. 7B illustrates an example of the original representation ofphysical user input for a user that draws a circle on a display screenof a UE and corresponding representations of the physical user input attarget UEs in accordance with an embodiment of the invention.

FIG. 7C illustrates a more detailed implementation of FIG. 7A inaccordance with an embodiment of the invention.

FIG. 8A illustrates an implementation of a portion of FIG. 7A inaccordance with an embodiment of the invention.

FIG. 8B illustrates an example implementation of FIG. 8A in accordancewith an embodiment of the invention.

FIG. 9 illustrates a process of selectively adjusting display settingsfor one or more target UEs during a communication session based onreceived user-generated physical input.

FIG. 10 illustrates an example implementation of the process describedin FIG. 9 in accordance with an embodiment of the invention.

DETAILED DESCRIPTION

Aspects of the invention are disclosed in the following description andrelated drawings directed to specific embodiments of the invention.Alternate embodiments may be devised without departing from the scope ofthe invention. Additionally, well-known elements of the invention willnot be described in detail or will be omitted so as not to obscure therelevant details of the invention.

The words “exemplary” and/or “example” are used herein to mean “servingas an example, instance, or illustration.” Any embodiment describedherein as “exemplary” and/or “example” is not necessarily to beconstrued as preferred or advantageous over other embodiments. Likewise,the term “embodiments of the invention” does not require that allembodiments of the invention include the discussed feature, advantage ormode of operation.

Further, many embodiments are described in terms of sequences of actionsto be performed by, for example, elements of a computing device. It willbe recognized that various actions described herein can be performed byspecific circuits (e.g., application specific integrated circuits(ASICs)), by program instructions being executed by one or moreprocessors, or by a combination of both. Additionally, these sequence ofactions described herein can be considered to be embodied entirelywithin any form of computer readable storage medium having storedtherein a corresponding set of computer instructions that upon executionwould cause an associated processor to perform the functionalitydescribed herein. Thus, the various aspects of the invention may beembodied in a number of different forms, all of which have beencontemplated to be within the scope of the claimed subject matter. Inaddition, for each of the embodiments described herein, thecorresponding form of any such embodiments may be described herein as,for example, “logic configured to” perform the described action (e.g.,described in more detail below with respect to FIG. 4).

A High Data Rate (HDR) subscriber station, referred to herein as userequipment (UE), may be mobile or stationary, and may communicate withone or more access points (APs), which may be referred to as Node Bs. AUE transmits and receives data packets through one or more of the NodeBs to a Radio Network Controller (RNC). The Node Bs and RNC are parts ofa network called a radio access network (RAN). A radio access networkcan transport voice and data packets between multiple access terminals.

The radio access network may be further connected to additional networksoutside the radio access network, such core network including specificcarrier related servers and devices and connectivity to other networkssuch as a corporate intranet, the Internet, public switched telephonenetwork (PSTN), a Serving General Packet Radio Services (GPRS) SupportNode (SGSN), a Gateway GPRS Support Node (GGSN), and may transport voiceand data packets between each UE and such networks. A UE that hasestablished an active traffic channel connection with one or more NodeBs may be referred to as an active UE, and can be referred to as beingin a traffic state. A UE that is in the process of establishing anactive traffic channel (TCH) connection with one or more Node Bs can bereferred to as being in a connection setup state. A UE may be any datadevice that communicates through a wireless channel or through a wiredchannel. A UE may further be any of a number of types of devicesincluding but not limited to PC card, compact flash device, external orinternal modem, or wireless or wireline phone. The communication linkthrough which the UE sends signals to the Node B(s) is called an uplinkchannel (e.g., a reverse traffic channel, a control channel, an accesschannel, etc.). The communication link through which Node B(s) sendsignals to a UE is called a downlink channel (e.g., a paging channel, acontrol channel, a broadcast channel, a forward traffic channel, etc.).As used herein the term traffic channel (TCH) can refer to either anuplink/reverse or downlink/forward traffic channel.

FIG. 1 illustrates a block diagram of one exemplary embodiment of awireless communications system 100 in accordance with at least oneembodiment of the invention. System 100 can contain UEs, such ascellular telephone 102, in communication across an air interface 104with an access network or radio access network (RAN) 120 that canconnect the UE 102 to network equipment providing data connectivitybetween a packet switched data network (e.g., an intranet, the Internet,and/or core network 126) and the UEs 102, 108, 110, 112. As shown here,the UE can be a cellular telephone 102, a personal digital assistant108, a pager 110, which is shown here as a two-way text pager, or even aseparate computer platform 112 that has a wireless communication portal.Embodiments of the invention can thus be realized on any form of UEincluding a wireless communication portal or having wirelesscommunication capabilities, including without limitation, wirelessmodems, PCMCIA cards, personal computers, telephones, or any combinationor sub-combination thereof. Further, as used herein, the term “UE” inother communication protocols (i.e., other than W-CDMA) may be referredto interchangeably as an “access terminal”, “AT”, “wireless device”,“client device”, “mobile terminal”, “mobile station” and variationsthereof

Referring back to FIG. 1, the components of the wireless communicationssystem 100 and interrelation of the elements of the exemplaryembodiments of the invention are not limited to the configurationillustrated. System 100 is merely exemplary and can include any systemthat allows remote UEs, such as wireless client computing devices 102,108, 110, 112 to communicate over-the-air between and among each otherand/or between and among components connected via the air interface 104and RAN 120, including, without limitation, core network 126, theInternet, PSTN, SGSN, GGSN and/or other remote servers.

The RAN 120 controls messages (typically sent as data packets) sent to aRNC 122. The RNC 122 is responsible for signaling, establishing, andtearing down bearer channels (i.e., data channels) between a ServingGeneral Packet Radio Services (GPRS) Support Node (SGSN) and the UEs102/108/110/112. If link layer encryption is enabled, the RNC 122 alsoencrypts the content before forwarding it over the air interface 104.The function of the RNC 122 is well-known in the art and will not bediscussed further for the sake of brevity. The core network 126 maycommunicate with the RNC 122 by a network, the Internet and/or a publicswitched telephone network (PSTN). Alternatively, the RNC 122 mayconnect directly to the Internet or external network. Typically, thenetwork or Internet connection between the core network 126 and the RNC122 transfers data, and the PSTN transfers voice information. The RNC122 can be connected to multiple Node Bs 124. In a similar manner to thecore network 126, the RNC 122 is typically connected to the Node Bs 124by a network, the Internet and/or PSTN for data transfer and/or voiceinformation. The Node Bs 124 can broadcast data messages wirelessly tothe UEs, such as cellular telephone 102. The Node Bs 124, RNC 122 andother components may form the RAN 120, as is known in the art. However,alternate configurations may also be used and the invention is notlimited to the configuration illustrated. For example, in anotherembodiment the functionality of the RNC 122 and one or more of the NodeBs 124 may be collapsed into a single “hybrid” module having thefunctionality of both the RNC 122 and the Node B(s) 124.

FIG. 2A illustrates the core network 126 according to an embodiment ofthe present invention. In particular, FIG. 2A illustrates components ofa General Packet Radio Services (GPRS) core network implemented within aW-CDMA system. In the embodiment of FIG. 2A, the core network 126includes a Serving GPRS Support Node (SGSN) 160, a Gateway GPRS SupportNode (GGSN) 165 and an Internet 175. However, it is appreciated thatportions of the Internet 175 and/or other components may be locatedoutside the core network in alternative embodiments.

Generally, GPRS is a protocol used by Global System for Mobilecommunications (GSM) phones for transmitting Internet Protocol (IP)packets. The GPRS Core Network (e.g., the GGSN 165 and one or more SGSNs160) is the centralized part of the GPRS system and also providessupport for W-CDMA based 3G networks. The GPRS core network is anintegrated part of the GSM core network, provides mobility management,session management and transport for IP packet services in GSM andW-CDMA networks.

The GPRS Tunneling Protocol (GTP) is the defining IP protocol of theGPRS core network. The GTP is the protocol which allows end users (e.g.,UEs) of a GSM or W-CDMA network to move from place to place whilecontinuing to connect to the internet as if from one location at theGGSN 165. This is achieved transferring the subscriber's data from thesubscriber's current SGSN 160 to the GGSN 165, which is handling thesubscriber's session.

Three forms of GTP are used by the GPRS core network; namely, (i) GTP-U,(ii) GTP-C and (iii) GTP' (GTP Prime). GTP-U is used for transfer ofuser data in separated tunnels for each packet data protocol (PDP)context. GTP-C is used for control signaling (e.g., setup and deletionof PDP contexts, verification of GSN reach-ability, updates ormodifications such as when a subscriber moves from one SGSN to another,etc.). GTP' is used for transfer of charging data from GSNs to acharging function.

Referring to FIG. 2A, the GGSN 165 acts as an interface between the GPRSbackbone network (not shown) and the Internet (i.e., an external packetdata network) 175. The GGSN 165 extracts the packet data with associatedpacket data protocol (PDP) format (e.g., IP or PPP) from the GPRSpackets coming from the SGSN 160, and sends the packets out on acorresponding packet data network. In the other direction, the incomingdata packets are directed by the GGSN 165 to the SGSN 160 which managesand controls the Radio Access Bearer (RAB) of the destination UE servedby the RAN 120. Thereby, the GGSN 165 stores the current SGSN address ofthe target UE and his/her profile in its location register (e.g., withina PDP context). The GGSN is responsible for IP address assignment and isthe default router for the connected UE. The GGSN also performsauthentication and charging functions.

The SGSN 160 is representative of one of many SGSNs within the corenetwork 126, in an example. Each SGSN is responsible for the delivery ofdata packets from and to the UEs within an associated geographicalservice area. The tasks of the SGSN 160 includes packet routing andtransfer, mobility management (e.g., attach/detach and locationmanagement), logical link management, and authentication and chargingfunctions. The location register of the SGSN stores location information(e.g., current cell, current VLR) and user profiles (e.g., IMSI, PDPaddress(es) used in the packet data network) of all GPRS usersregistered with the SGSN 160, for example, within one or more PDPcontexts for each user or UE. Thus, SGSNs are responsible for (i)de-tunneling downlink GTP packets from the GGSN 165, (ii) uplink tunnelIP packets toward the GGSN 165, (iii) carrying out mobility managementas UEs move between SGSN service areas and (iv) billing mobilesubscribers. As will be appreciated by one of ordinary skill in the art,aside from (i)-(iv), SGSNs configured for GSM/EDGE networks haveslightly different functionality as compared to SGSNs configured forW-CDMA networks.

The RAN 120 (e.g., or UTRAN, in Universal Mobile TelecommunicationsSystem (UMTS) system architecture) communicates with the SGSN 160 via aRadio Access Network Application Part (RANAP) protocol. RANAP operatesover a Iu interface (Iu-ps), with a transmission protocol such as FrameRelay or IP. The SGSN 160 communicates with the GGSN 165 via a Gninterface, which is an IP-based interface between SGSN 160 and otherSGSNs (not shown) and internal GGSNs, and uses the GTP protocol definedabove (e.g., GTP-U, GTP-C, GTP′, etc.). In the embodiment of FIG. 2A,the Gn between the SGSN 160 and the GGSN 165 carries both the GTP-C andthe GTP-U. While not shown in FIG. 2A, the Gn interface is also used bythe Domain Name System (DNS). The GGSN 165 is connected to a Public DataNetwork (PDN) (not shown), and in turn to the Internet 175, via a Giinterface with IP protocols either directly or through a WirelessApplication Protocol (WAP) gateway.

FIG. 2B illustrates the core network 126 according to another embodimentof the present invention. FIG. 2B is similar to FIG. 2A except that FIG.2B illustrates an implementation of direct tunnel functionality.

Direct Tunnel is an optional function in Iu mode that allows the SGSN160 to establish a direct user plane tunnel, GTP-U, between RAN and GGSNwithin the Packet Switched (PS) domain. A direct tunnel capable SGSN,such as SGSN 160 in FIG. 2B, can be configured on a per GGSN and per RNCbasis whether or not the SGSN can use a direct user plane connection.The SGSN 160 in FIG. 2B handles the control plane signaling and makesthe decision of when to establish Direct Tunnel. When the Radio Bearer(RAB) assigned for a PDP context is released (i.e. the PDP context ispreserved) the GTP-U tunnel is established between the GGSN 165 and SGSN160 in order to be able to handle the downlink packets.

The optional Direct Tunnel between the SGSN 160 and GGSN 165 is nottypically allowed (i) in the roaming case (e.g., because the SGSN needsto know whether the GGSN is in the same or different PLMN), (ii) wherethe SGSN has received Customized Applications for Mobile Enhanced Logic(CAMEL) Subscription Information in the subscriber profile from a HomeLocation Register (HLR) and/or (iii) where the GGSN 165 does not supportGTP protocol version 1. With respect to the CAMEL restriction, if DirectTunnel is established then volume reporting from SGSN 160 is notpossible as the SGSN 160 no longer has visibility of the User Plane.Thus, since a CAMEL server can invoke volume reporting at anytime duringthe life time of a PDP Context, the use of Direct Tunnel is prohibitedfor a subscriber whose profile contains CAMEL Subscription Information.

The SGSN 160 can be operating in a Packet Mobility Management(PMM)-detached state, a PMM-idle state or a PMM-connected state. In anexample, the GTP-connections shown in FIG. 2B for Direct Tunnel functioncan be established whereby the SGSN 160 is in the PMM-connected stateand receives an Iu connection establishment request from the UE. TheSGSN 160 ensures that the new Iu connection and the existing Iuconnection are for the same UE, and if so, the SGSN 160 processes thenew request and releases the existing Iu connection and all RABsassociated with it. To ensure that the new Iu connection and theexisting one are for the same UE, the SGSN 160 may perform securityfunctions. If Direct Tunnel was established for the UE, the SGSN 160sends an Update PDP Context Request(s) to the associated GGSN(s) 165 toestablish the GTP tunnels between the SGSN 160 and GGSN(s) 165 in casethe Iu connection establishment request is for signaling only. The SGSN160 may immediately establish a new direct tunnel and send Update PDPContext Request(s) to the associated GGSN(s) 165 and include the RNC'sAddress for User Plane, a downlink Tunnel Endpoint Identifier (TEID) fordata in case the Iu connection establishment request is for datatransfer.

The UE also performs a Routing Area Update (RAU) procedure immediatelyupon entering PMM-IDLE state when the UE has received an RRC ConnectionRelease message with cause “Directed Signaling connectionre-establishment” even if the Routing Area has not changed since thelast update. In an example, the RNC will send the RRC Connection Releasemessage with cause “Directed Signaling Connection re-establishment” whenthe RNC is unable to contact the Serving RNC to validate the UE due tolack of Iur connection (e.g., see TS 25.331 [52]). The UE performs asubsequent service request procedure after successful completion of theRAU procedure to re-establish the radio access bearer when the UE haspending user data to send.

The PDP context is a data structure present on both the SGSN 160 and theGGSN 165 which contains a particular UE's communication sessioninformation when the UE has an active GPRS session. When a UE wishes toinitiate a GPRS communication session, the UE must first attach to theSGSN 160 and then activate a PDP context with the GGSN 165. Thisallocates a PDP context data structure in the SGSN 160 that thesubscriber is currently visiting and the GGSN 165 serving the UE'saccess point.

FIG. 2C illustrates an example of the wireless communications system 100of FIG. 1 in more detail. In particular, referring to FIG. 2C, UEs 1 . .. N are shown as connecting to the RAN 120 at locations serviced bydifferent packet data network end-points. The illustration of FIG. 2C isspecific to W-CDMA systems and terminology, although it will beappreciated how FIG. 2C could be modified to conform with a 1× EV-DOsystem. Accordingly, UEs 1 and 3 connect to the RAN 120 at a portionserved by a first packet data network end-point 162 (e.g., which maycorrespond to SGSN, GGSN, PDSN, a home agent (HA), a foreign agent (FA),etc.). The first packet data network end-point 162 in turn connects, viathe routing unit 188, to the Internet 175 and/or to one or more of anauthentication, authorization and accounting (AAA) server 182, aprovisioning server 184, an Internet Protocol (IP) Multimedia Subsystem(IMS)/Session Initiation Protocol (SIP) Registration Server 186 and/orthe application server 170. UEs 2 and 5 . . . N connect to the RAN 120at a portion served by a second packet data network end-point 164 (e.g.,which may correspond to SGSN, GGSN, PDSN, FA, HA, etc.). Similar to thefirst packet data network end-point 162, the second packet data networkend-point 164 in turn connects, via the routing unit 188, to theInternet 175 and/or to one or more of the AAA server 182, a provisioningserver 184, an IMS/SIP Registration Server 186 and/or the applicationserver 170. UE 4 connects directly to the Internet 175, and through theInternet 175 can then connect to any of the system components describedabove.

Referring to FIG. 2C, UEs 1, 3 and 5 . . . N are illustrated as wirelesscell-phones, UE 2 is illustrated as a wireless tablet-PC and UE 4 isillustrated as a wired desktop station. However, in other embodiments,it will be appreciated that the wireless communication system 100 canconnect to any type of UE, and the examples illustrated in FIG. 2C arenot intended to limit the types of UEs that may be implemented withinthe system. Also, while the AAA 182, the provisioning server 184, theIMS/SIP registration server 186 and the application server 170 are eachillustrated as structurally separate servers, one or more of theseservers may be consolidated in at least one embodiment of the invention.

Further, referring to FIG. 2C, the application server 170 is illustratedas including a plurality of media control complexes (MCCs) 1 . . . N170B, and a plurality of regional dispatchers 1 . . . N 170A.Collectively, the regional dispatchers 170A and MCCs 170B are includedwithin the application server 170, which in at least one embodiment cancorrespond to a distributed network of servers that collectivelyfunctions to arbitrate communication sessions (e.g., half-duplex groupcommunication sessions via IP unicasting and/or IP multicastingprotocols) within the wireless communication system 100. For example,because the communication sessions arbitrated by the application server170 can theoretically take place between UEs located anywhere within thesystem 100, multiple regional dispatchers 170A and MCCs are distributedto reduce latency for the arbitrated communication sessions (e.g., sothat an

MCC in North America is not relaying media back-and-forth betweensession participants located in China). Thus, when reference is made tothe application server 170, it will be appreciated that the associatedfunctionality can be enforced by one or more of the regional dispatchers170A and/or one or more of the MCCs 170B. The regional dispatchers 170Aare generally responsible for any functionality related to establishinga communication session (e.g., handling signaling messages between theUEs, scheduling and/or sending announce messages, etc.), whereas theMCCs 170B are responsible for hosting the communication session for theduration of the call instance, including conducting an in-call signalingand an actual exchange of media during an arbitrated communicationsession.

Referring to FIG. 3, a UE 200, (here a wireless device), such as acellular telephone, has a platform 202 that can receive and executesoftware applications, data and/or commands transmitted from the RAN 120that may ultimately come from the core network 126, the Internet and/orother remote servers and networks. The platform 202 can include atransceiver 206 operably coupled to an application specific integratedcircuit (“ASIC” 208), or other processor, microprocessor, logic circuit,or other data processing device. The ASIC 208 or other processorexecutes the application programming interface (“API') 210 layer thatinterfaces with any resident programs in the memory 212 of the wirelessdevice. The memory 212 can be comprised of read-only or random-accessmemory (RAM and ROM), EEPROM, flash cards, or any memory common tocomputer platforms. The platform 202 also can include a local database214 that can hold applications not actively used in memory 212. Thelocal database 214 is typically a flash memory cell, but can be anysecondary storage device as known in the art, such as magnetic media,EEPROM, optical media, tape, soft or hard disk, or the like. Theinternal platform 202 components can also be operably coupled toexternal devices such as antenna 222, display 224, push-to-talk button228 and keypad 226 among other components, as is known in the art.

Accordingly, an embodiment of the invention can include a UE includingthe ability to perform the functions described herein. As will beappreciated by those skilled in the art, the various logic elements canbe embodied in discrete elements, software modules executed on aprocessor or any combination of software and hardware to achieve thefunctionality disclosed herein. For example, ASIC 208, memory 212, API210 and local database 214 may all be used cooperatively to load, storeand execute the various functions disclosed herein and thus the logic toperform these functions may be distributed over various elements.Alternatively, the functionality could be incorporated into one discretecomponent. Therefore, the features of the UE 200 in FIG. 3 are to beconsidered merely illustrative and the invention is not limited to theillustrated features or arrangement.

The wireless communication between the UE 102 or 200 and the RAN 120 canbe based on different technologies, such as code division multipleaccess (CDMA), W-CDMA, time division multiple access (TDMA), frequencydivision multiple access (FDMA), Orthogonal Frequency DivisionMultiplexing (OFDM), the Global System for Mobile Communications (GSM),or other protocols that may be used in a wireless communications networkor a data communications network. For example, in W-CDMA, the datacommunication is typically between the client device 102, Node B(s) 124,and the RNC 122. The RNC 122 can be connected to multiple data networkssuch as the core network 126, PSTN, the Internet, a virtual privatenetwork, a SGSN, a GGSN and the like, thus allowing the UE 102 or 200access to a broader communication network. As discussed in the foregoingand known in the art, voice transmission and/or data can be transmittedto the UEs from the RAN using a variety of networks and configurations.Accordingly, the illustrations provided herein are not intended to limitthe embodiments of the invention and are merely to aid in thedescription of aspects of embodiments of the invention.

FIG. 4 illustrates a communication device 400 that includes logicconfigured to perform functionality. The communication device 400 cancorrespond to any of the above-noted communication devices, includingbut not limited to UEs 102, 108, 110, 112 or 200, Node Bs or basestations 120, the RNC or base station controller 122, a packet datanetwork end-point (e.g., SGSN 160, GGSN 165, a Mobility ManagementEntity (MME) in Long Term Evolution (LTE), etc.), any of the servers 170through 186, etc. Thus, communication device 400 can correspond to anyelectronic device that is configured to communicate with (or facilitatecommunication with) one or more other entities over a network.

Referring to FIG. 4, the communication device 400 includes logicconfigured to receive and/or transmit information 405. In an example, ifthe communication device 400 corresponds to a wireless communicationsdevice (e.g., UE 200, Node B 124, etc.), the logic configured to receiveand/or transmit information 405 can include a wireless communicationsinterface (e.g., Bluetooth, WiFi, 2G, 3G, etc.) such as a wirelesstransceiver and associated hardware (e.g., an RF antenna, a MODEM, amodulator and/or demodulator, etc.). In another example, the logicconfigured to receive and/or transmit information 405 can correspond toa wired communications interface (e.g., a serial connection, a USB orFirewire connection, an Ethernet connection through which the Internet175 can be accessed, etc.). Thus, if the communication device 400corresponds to some type of network-based server (e.g., SGSN 160, GGSN165, application server 170, etc.), the logic configured to receiveand/or transmit information 405 can correspond to an Ethernet card, inan example, that connects the network-based server to othercommunication entities via an Ethernet protocol. In a further example,the logic configured to receive and/or transmit information 405 caninclude sensory or measurement hardware by which the communicationdevice 400 can monitor its local environment (e.g., an accelerometer, atemperature sensor, a light sensor, an antenna for monitoring local RFsignals, etc.). The logic configured to receive and/or transmitinformation 405 can also include software that, when executed, permitsthe associated hardware of the logic configured to receive and/ortransmit information 405 to perform its reception and/or transmissionfunction(s). However, the logic configured to receive and/or transmitinformation 405 does not correspond to software alone, and the logicconfigured to receive and/or transmit information 405 relies at least inpart upon hardware to achieve its functionality.

Referring to FIG. 4, the communication device 400 further includes logicconfigured to process information 410. In an example, the logicconfigured to process information 410 can include at least a processor.Example implementations of the type of processing that can be performedby the logic configured to process information 410 includes but is notlimited to performing determinations, establishing connections, makingselections between different information options, performing evaluationsrelated to data, interacting with sensors coupled to the communicationdevice 400 to perform measurement operations, converting informationfrom one format to another (e.g., between different protocols such as.wmv to .avi, etc.), and so on. For example, the processor included inthe logic configured to process information 410 can correspond to ageneral purpose processor, a digital signal processor (DSP), anapplication specific integrated circuit (ASIC), a field programmablegate array (FPGA) or other programmable logic device, discrete gate ortransistor logic, discrete hardware components, or any combinationthereof designed to perform the functions described herein. A generalpurpose processor may be a microprocessor, but in the alternative, theprocessor may be any conventional processor, controller,microcontroller, or state machine. A processor may also be implementedas a combination of computing devices, e.g., a combination of a DSP anda microprocessor, a plurality of microprocessors, one or moremicroprocessors in conjunction with a DSP core, or any other suchconfiguration. The logic configured to process information 410 can alsoinclude software that, when executed, permits the associated hardware ofthe logic configured to process information 410 to perform itsprocessing function(s). However, the logic configured to processinformation 410 does not correspond to software alone, and the logicconfigured to process information 410 relies at least in part uponhardware to achieve its functionality.

Referring to FIG. 4, the communication device 400 further includes logicconfigured to store information 415. In an example, the logic configuredto store information 415 can include at least a non-transitory memoryand associated hardware (e.g., a memory controller, etc.). For example,the non-transitory memory included in the logic configured to storeinformation 415 can correspond to RAM memory, flash memory, ROM memory,EPROM memory, EEPROM memory, registers, hard disk, a removable disk, aCD-ROM, or any other form of storage medium known in the art. The logicconfigured to store information 415 can also include software that, whenexecuted, permits the associated hardware of the logic configured tostore information 415 to perform its storage function(s). However, thelogic configured to store information 415 does not correspond tosoftware alone, and the logic configured to store information 415 reliesat least in part upon hardware to achieve its functionality.

Referring to FIG. 4, the communication device 400 further optionallyincludes logic configured to present information 420. In an example, thelogic configured to display information 420 can include at least anoutput device and associated hardware. For example, the output devicecan include a video output device (e.g., a display screen, a port thatcan carry video information such as USB, HDMI, etc.), an audio outputdevice (e.g., speakers, a port that can carry audio information such asa microphone jack, USB, HDMI, etc.), a vibration device and/or any otherdevice by which information can be formatted for output or actuallyoutputted by a user or operator of the communication device 400. Forexample, if the communication device 400 corresponds to UE 200 as shownin FIG. 3, the logic configured to present information 420 can includethe display 224. In a further example, the logic configured to presentinformation 420 can be omitted for certain communication devices, suchas network communication devices that do not have a local user (e.g.,network switches or routers, remote servers, etc.). The logic configuredto present information 420 can also include software that, whenexecuted, permits the associated hardware of the logic configured topresent information 420 to perform its presentation function(s).However, the logic configured to present information 420 does notcorrespond to software alone, and the logic configured to presentinformation 420 relies at least in part upon hardware to achieve itsfunctionality.

Referring to FIG. 4, the communication device 400 further optionallyincludes logic configured to receive local user input 425. In anexample, the logic configured to receive local user input 425 caninclude at least a user input device and associated hardware. Forexample, the user input device can include buttons, a touch-screendisplay, a keyboard, a camera, an audio input device (e.g., a microphoneor a port that can carry audio information such as a microphone jack,etc.), and/or any other device by which information can be received froma user or operator of the communication device 400. For example, if thecommunication device 400 corresponds to UE 200 as shown in FIG. 3, thelogic configured to receive local user input 425 can include the display224 (if implemented a touch-screen), keypad 226, etc. In a furtherexample, the logic configured to receive local user input 425 can beomitted for certain communication devices, such as network communicationdevices that do not have a local user (e.g., network switches orrouters, remote servers, etc.). The logic configured to receive localuser input 425 can also include software that, when executed, permitsthe associated hardware of the logic configured to receive local userinput 425 to perform its input reception function(s). However, the logicconfigured to receive local user input 425 does not correspond tosoftware alone, and the logic configured to receive local user input 425relies at least in part upon hardware to achieve its functionality.

Referring to FIG. 4, while the configured logics of 405 through 425 areshown as separate or distinct blocks in FIG. 4, it will be appreciatedthat the hardware and/or software by which the respective configuredlogic performs its functionality can overlap in part. For example, anysoftware used to facilitate the functionality of the configured logicsof 405 through 425 can be stored in the non-transitory memory associatedwith the logic configured to store information 415, such that theconfigured logics of 405 through 425 each performs their functionality(i.e., in this case, software execution) based in part upon theoperation of software stored by the logic configured to storeinformation 405. Likewise, hardware that is directly associated with oneof the configured logics can be borrowed or used by other configuredlogics from time to time. For example, the processor of the logicconfigured to process information 410 can format data into anappropriate format before being transmitted by the logic configured toreceive and/or transmit information 405, such that the logic configuredto receive and/or transmit information 405 performs its functionality(i.e., in this case, transmission of data) based in part upon theoperation of hardware (i.e., the processor) associated with the logicconfigured to process information 410. Further, the configured logics or“logic configured to” of 405 through 425 are not limited to specificlogic gates or elements, but generally refer to the ability to performthe functionality describe herein (either via hardware or a combinationof hardware and software). Thus, the configured logics or “logicconfigured to” of 405 through 425 are not necessarily implemented aslogic gates or logic elements despite sharing the word “logic”. Otherinteractions or cooperation between the configured logics 405 through425 will become clear to one of ordinary skill in the art from a reviewof the embodiments described below in more detail.

It is typical for media (e.g., audio, video, text, etc.) to be presentedby UEs during a server-arbitrated group communication session. Forexample, in a half-duplex video communication session, video media canbe transmitted from a floor-holder to the application server 170, andthe application server 170 can then re-transmit the video media to thegroup for presentation at target UE(s).

In conjunction with the presentation of media during the groupcommunication session, one or more of the UEs participating in thesession can receive physical user input from their respective users andthen transmit control information indicative of the received physicaluser input to the rest of the group. For example, the physical userinput can correspond to a form of telestration (e.g., on-screen drawing)whereby a user of a given UE circles a portion of an associated display,a graphic representative of the user's circle is added to the displayand then transmitted to the rest of the group where the circle isre-constituted. In this examples, the given user's attempt to highlighta point of interest on his/her display via the circle is disseminated tothe rest of the group and overlaid on top of the rendering of the videomedia at the respective target UE(s).

However, UEs with different presentation capabilities and/or connectionperformance levels can participate in the same server-arbitratedcommunication session. For example, a UE connected to a 3G network maybe part of the same communication session as a UE connected to a 4G orWLAN. In another example, a UE with a high-resolution display can bepart of the same communication session as a UE with a low-resolutiondisplay. Accordingly, an embodiment of the invention are directed to animplementation whereby visual representations of physical user input areshared between UEs participating a group communication session inaccordance with the capabilities and/or performance levels associatedwith the target UE(s).

FIG. 5 illustrates a process of exchanging data representative ofphysical user input during a group communication in accordance with anembodiment of the present invention. Referring to FIG. 5, assume thatUEs 1 . . . N (e.g., where N≧2) are engaged in a communication sessionthat involves a graphical media representation on displays at each ofUEs 1 . . . N. In an example, the communication session can correspondto a video conferencing session whereby the same video and/or imagemedia is displayed at each of UEs 1 . . . N (e.g., a collaborative mapsession, etc.). Alternatively, different video and/or image media can bepresented at two or more of UEs 1 . . . N (e.g., UE 1 may view UE 2'svideo media, UE 2 may view UE 1's video media, and so on). In anexample, the video and/or image media need not be actively mediatedthrough the application server 170, but could also be renderedindependently at UEs 1 . . . N. For example, audio media can be mediatedby the application server 170 (e.g., half duplex or full duplex), butthe video and/or image media could be loaded separately at the UEs 1 . .. N. For example, UEs 1 . . . N could each be independently rendering amap of New York while discussing their travel plans so that the map datadoes not need to be actively exchanged between the UEs during thecommunication session.

Referring to FIG. 5, during the communication session, the applicationserver 170 receives data from a given UE (“UE 1”) that is configured tovisually represent a physical user input at the given UE, 500. Thephysical user input that is configured to be visually represented by thedata received at 500 can include a user of UE 1 circling a relevant partof the display on the given UE with his/her finger, the userhighlighting a portion of the display on the given UE, and so on. Thedata representative of the physical user input that is received at 500can be received in many different formats or levels of precision. Forexample, the received data at 500 can correspond to a set of screencoordinates that were associated with the physical user input (e.g.,which when connected collectively form a circle, a squiggly line, etc.).

Referring to FIG. 5, the application server 170 then determines datapresentation capabilities of at least one target UE (e.g., one or moreof UEs 2 . . . N) and/or a connection performance level from theapplication server 170 to the at least one target UE, 505. In anexample, the determined presentation capabilities of the at least onetarget UE can include display capability of the at least one target UE,such as, but not limited to, display size, color resolution, frame rate,display resolution, aspect ratio and so on. In another example, thedetermined data presentation capabilities of the at least one target UEcan depend on a performance capability of the at least one target UE,such as, but not limited to, processor speed, memory capacity, type ofmemory, clock frequency, battery life and power conservationrequirements.

Furthermore, as noted above with respect to 505 of FIG. 5, theapplication server 170 can also determine the connection performancelevel associated with the application server 170's connection to the atleast one target UE. For example, the performance level to the at leastone target UE can be inferred based on packet loss, round trip delay orother in-call parameters. In another example, the performance level tothe target UE can be based upon information related to a serving networkof the at least one target UE. For example, the application server 170may generally determine higher performance capabilities for 4G-connectedUEs as compared to 3G-connected UEs. In another example, the applicationserver 170 may be aware of network-specific performance expectations(e.g., from prior interactions serving UEs over the same network or thesame type of network, etc.)

Referring to FIG. 5, the application server 170 selectively transitionsthe received data from a first level of precision (e.g., a high-qualityor full-quality format as received from the given UE at 500) to a secondlevel of precision (e.g., a reduced quality format) based on thedetermined data presentation capabilities and/or connection performancelevel for the target UE, 510. For example, if the received datarepresentative of the physical user input from 500 corresponds to a setof 1000 screen-coordinates, the transitioning of 510 can reduce thenumber of screen coordinates to a number that is appropriate fordelivery and/or presentation at the at least one target UE based on thedetermined presentation capabilities and/or connection performance levelof the at least one target UE (e.g., 700 screen-coordinates, coordinatesfor a center-point and a size of a pre-defined shape, screen-coordinatesthat correspond to vertexes of a pre-defined polygon and an associatedcenter-point, etc.). In another example, the application server 170 canprioritize the transition of the received data at 510 based on anexpected level of human sensitivity to each aspect targeted fortransition or reduction in order to improve the user experience (e.g.,reduce resolution but not frame-rate, etc.). In another example, assumethat the received data representative of the physical user input from500 includes complex forms, shading, and color coding. In this case, thetransition of this data to the second level of precision at 510 caninclude simplifying the complex form, reducing or eliminating theshading and/or reducing the number of associated colors.

Still referring to 510 of FIG. 5, in another example, if the determinedconnection performance level at 505 for a particular target UE is low,the transitioned data at 510 can be scaled down to a thumbnail size andthen “stretched” for presentation once received by the particular targetUE in order to fill its display screen. In another example, in 510, theshape of the received data of 500 can be reconstructed to reduce imagesize. In another example, in 510, the received data from the given UE at500 can contain image data that is representative of a user's selectionson a map, and the received data can be converted from the image datainto a set of GPS location and/or Cartesian coordinates for the map, sothat the image data can be reconstructed at the display of the at leastone target UE. As will be discussed below in more detail, at theapplication server 170, the manner in which the received data istransitioned in 510 can be the same for each target UE, or alternativelycan vary between target UEs based on UE-specific determinations from505.

Referring to FIG. 5, after the received data representative of thephysical user input from the given UE is transitioned into the secondlevel of precision at 510, the application server 170 transmits theselectively transitioned data to the at least one target UE forpresentation thereon, 515.

FIG. 6 illustrates a communication flow that is based upon an executionof the process of FIG. 5 in accordance with an embodiment of theinvention. Referring to FIG. 6, UE 1 and UE 2 are engaged in acommunication session that involves some type of collaborative graphicaldisplay of media. During the communication session, a user of UE 1provides physical user input that results in a squiggly, complex shapeshown in shape 600. For example, the user of UE 1 may have waved his/herfinger in proximity to a touchscreen display of UE 1, after which UE 1'ssensors record the finger-waving for display as the shape 600. The shape600 may be referred to as an original or full-quality (or highprecision) representation of the physical user input (e.g., at leastrelative to the initial recording or capturing of the physical userinput). In an example, the original representation of the physical userinput can include encoding of a plurality of coordinates and/or vertexesthat collectively define the shape when rendered on the display of UE 1.Data representative of the shape 600 is transmitted by UE 1 to theapplication server 170, 605.

While not shown in FIG. 6 explicitly, assume that the application server170 receives the representative data from UE 1 and executes the processof FIG. 5. Thus, 610 of FIG. 6 shows the transmission of the selectivelytransitioned data that is representative of the shape 600, albeit in areduced or simplified level of precision. The target UE (e.g., UE 2)receives the selectively transitioned data and presents a modified shape615. The modified shape 615 is still representative of (or faithful to)the initial physical user input at UE 1, but the modified shape issomewhat simpler and/or reduced in comparison to the full-qualityrepresentation of the physical user input that was captured and thenpresented at UE 1. The reduction and/or simplification to the datarepresentative of the physical user input can occur for a number ofreasons as noted above with respect to FIG. 5, such as a low-bandwidthconnection between the application server 170 and UE 2, displayrestrictions associated with UE 2, etc.

FIG. 7A illustrates an example implementation of the process of FIG. 5in accordance with an embodiment of the invention.

Referring to FIG. 7A, the UE 1 receives a physical user input during agroup communication session with UE 2 . . . N, at 700A. Next, UE 1presents an original representation of the physical user input at afirst level of precision, at 705A. For example, referring to FIG. 7B,700B is an example of the original representation of the physical userinput for a user that draws a circle on a display screen of UE 1 that isshowing a map of New York. As shown in 700B of FIG. 7B, the circleincludes a lot of detail and is fairly complex because user movement isimperfect or was deliberately non-linear. Another example of thepresentation of the original representation of the physical user inputis the shape 600 discussed above with respect to FIG. 6.

Referring to FIG. 6, UE 1 sends data representative of the physical userinput from 700A to the application server 170, 710A. The transmission ofthe data at 710A corresponds to FIG. 6 at 605 and/or FIG. 5 at 500. Theapplication server 170 receives the data representative of the physicaluser input from UE 1, after which 715A, 720A and 725A correspond to 505,510 and 515, respectively, of FIG. 5.

Once the data at the second level of precision is received by the targetUE(s) (e.g. UE 2 . . . N), the target UE(s) present the selectivelytransitioned representation of the physical user input, at 730A. Forexample, referring to FIG. 7B, the representation of the physical userinput at target UEs 2 . . . N can correspond to any of 705B, 710B or715B. In 705B, a relatively simple circle is shown instead of thecomplexity of the original representation of 700B. For example, theapplication server 170 can transition the original data from UE 1 thatis visually representative of the physical user input into a data formatthat defines a radius, thickness, color, and/or center point of thecircle shown at 705B. 705B can be the representation presented at arelatively low performing target UE or a target UE with a poorconnection. The presentation of 710B, on the other hand, is the same as700B (i.e., no transition). In this case, 710B can be the representationpresented at a relatively high performing target UE or a target UE witha good connection because the original representation from UE 1 did notundergo a quality (or precision) reduction. In 715B, a relatively simpleoctagon is shown instead of the complexity of the originalrepresentation of 700B. For example, the application server 170 cantransition the original data from UE 1 that is representative of thephysical user input into a data format (or level of precision) thatdefines the vertexes and/or center point of the octagon shown at 715B.715B can be an example of another representation presented at arelatively low performing target UE or a target UE with a poorconnection.

FIG. 7C illustrates a more detailed implementation of FIG. 7A inaccordance with an embodiment of the invention. In FIG. 7C, 700C through715C and 730C through 740C correspond to 700A through 730A of FIG. 7A,respectively, and will not be discussed further for the sake of brevity.

FIG. 7C differs from FIG. 7A with the inclusion of 720C and 725C.Referring to FIG. 7C, after determining the data presentationcapabilities of the target UE(s) and/or performance level of aconnection to the target UE(s), at 715C, the application server 170determines a set of low-performing UE(s) among the target UE(s) based onthe determined data presentation capabilities and/or the performancelevel of the connection, at 720C. A low performing UE can include, butis not limited to, a UE with low display performance specifications(e.g., cannot handle high-resolution video stream), or a UE with a lowthroughput bandwidth connection (e.g., a 1× connection with theapplication server 170). Accordingly, the application server 170 mayadjust the participation level of the set of low-performing nodes in thegroup session, at 725C. Examples of adjusting the participation levelcan include, but are not limited to: dropping the set of low performingUEs from a full duplex to a half-duplex interaction with respect to thecommunication session; lowering the frame rates transmitted to the setof low performing UEs; lowering an image resolution of image mediatransmitted from the application server 170 to the set of low performingnodes; and/or lowering an audio rate of audio media transmitted from theapplication server 170 to the set of low performing UEs.

FIG. 8A illustrates an implementation of the process of 720A of FIG. 7Ain accordance with an embodiment of the invention. In FIG. 7A, UEs 2 . .. N are described whereby N can equal 2 or alternatively N can begreater than 2. However, FIG. 8A assumes that N is greater than two suchthat the application server 170 is responsible for re-formatting datarepresenting UE 1's physical user input for a plurality of target UEs.More specifically, FIG. 8A illustrates an example where the applicationserver 170 selectively transitions the received data into differentformats (or levels of precision) for different sets of target UEs basedon each set's respective determined data presentation capabilitiesand/or connection level.

Referring to FIG. 8A, assume that determination of 715A of FIG. 7Aresulted in the application server 170 categorizing the plurality oftarget UEs into a first group including target UEs with low presentationcapabilities and/or connection performance, a second group includingtarget UEs with intermediate presentation capabilities and/or connectionperformance and a third group including target UEs with highpresentation capabilities (e.g., top-of-the-line smart phone) and/orconnection performance (e.g., 3G, 4G, Wi-Fi connection).

Under these assumptions, referring to FIGS. 8A and 8B, the selectivetransitioning of 720A of FIG. 7A can include a first transition of thereceived data from the first level of precision (i.e., the receivedlevel of precision, such as shape 600 of FIG. 6 or 700B of FIG. 7B orFIG. 8B) to a second level of precision for the first group (e.g., asshown in 705B of FIG. 7B and/or FIG. 8B, for example), 800A, theselective transitioning of 720A of FIG. 7A can include a secondtransition of the received data from the first level of precision into athird level of precision for the second group (e.g., as shown in 715B ofFIG. 7B and/or FIG. 8B, for example), 810A, and the selectivetransitioning of 720A of FIG. 7A can include no transition of thereceived data for the third group, 820A (e.g., as shown in 710B of FIG.7B and/or FIG. 8B, for example).

While the above-described embodiments related to FIGS. 5 through 8B aredirected to sharing data that represents physical user input between UEsin a communication session, FIG. 9 is directed towards using physicaluser input at a given UE to control device display settings at one ormore other UEs participating in the communication session. As will beappreciated from the description below with respect to FIGS. 9 and 10,any of the processes described above with respect to FIGS. 5 through 8Bcan be executed in parallel with the processes of FIGS. 9 and/or 10.Alternatively, FIGS. 9 and 10 can be executed in an independent manner,such that the physical user input described below as triggering adisplay adjustment at the target UE(s) need not be associated with thephysical user input described above with respect to FIGS. 5 through 8B.

FIG. 9 illustrates a process of selectively adjusting display settingsfor one or more target UEs during a communication session based onreceived user-generated physical input. In particular, FIG. 9illustrates an example whereby physical user input at first UE (e.g., auser rotating UE 1) is reported to the application server 170 that isarbitrating a communication session for UEs 1 . . . N, and theapplication server 170 selectively controls or adjusts the displaysettings of the target UE(s) 2 . . . N (e.g., such as display settingsof UE 2 is adjusted by rotating display orientation).

Referring to FIG. 9, UEs 1 . . . N and the application server 170exchange media between UEs 1 . . . N during a group communicationsession, 900. During the group communication session, UE 1 receives aphysical user input (e.g., rotation of the phone) that is recognized asa prompt to adjust display settings at one or more of the target UE(s) 2. . . N, 905. For example, UE 1 may be provisioned with a set ofpre-defined user gestures (or physical user inputs) that are eachassociated with corresponding display setting adjustment(s) to beimplemented at UEs in communication with UE 1. For example, UE 1 maydetect that the user temporarily reorients UE 1 (e.g., from portraitmode to landscape mode). This detection can occur based on sensorcoupled to UE 1, such as an accelerometer, a gyroscope, etc. UE 1reports the detected physical user input to the application server 170in 910 to request that the application server 170 change the displaysettings at the target UE(s) 2 . . . N. Table 1 (below) lists a set ofexample pre-defined physical user inputs that, when detected at UE 1,are associated display setting adjustments for one or more of targetUE(s) 2 . . . N:

TABLE 1 Physical User Input Display Setting Adjustment at UE 1 at TargetUE(s) Affected UE(s) Rotate UE 90 degrees Rotate Display Screen UEs 2 .. . N clockwise Orientation by 90 degrees clockwise Shake UE Shake orRattle Screen UE 2 and UE 4 only Display, (Optional: Vibrate UE) TapLeft Side of UE Change Color Scheme of UE 2 and UE 3 X times ScreenDisplay Based on X

In response to the request of 910, the application server 170selectively adjusts the display settings for the target UE(s) (e.g., UE2 . . . N), 915. In an example, the selective adjustment to the displaysettings can be implemented within the media stream being mediated bythe application server 170, or alternatively can be implementedindirectly at the target UE(s) 2 . . . N based on control signaling fromthe application server 170. For example, if the physical user inputdetected at 905 is associated with an orientation change for UEs 2 . . .N, the orientation change can be server-implemented such that theapplication server 170 itself re-maps the graphical media to the targetorientation. Alternatively, the orientation change can beUE-implemented, whereby the application server 170 sends an orientationadjustment command to UEs 2 . . . N, after which UEs 2 . . . N willre-orient the unchanged incoming media stream to the target orientationat their end. Irrespective of whether the display setting adjustment isserver-implemented or UE-implemented, at 920, the display settings atthe target UE(s) 2 . . . N are adjusted based on the physical user inputfrom 905.

FIG. 10 illustrates an example implementation of the process describedin FIG. 9 in accordance with an embodiment of the invention. Inparticular FIG. 10 illustrates example screen shots at a transmitting UE1 and a target UE 2 during an example implementation of the process ofFIG. 9.

Referring to FIGS. 10, 1000 and 1010 illustrate states of the groupcommunication session at UE 1 and UE 2, respectively, during 900 and 905of FIG. 9, respectively. Accordingly, as shown in 1000 and 1005, UE 1and UE 2 are each held in an upright position (or vertical orientation)by their respective users and UEs 1 and 2 are displaying a verticallyoriented smiley face graphic. Next, during the communication session, auser of UE 1 turns UE 1 90 degrees so that UE 1 obtains a horizontalorientation, 1010. The user's turning of UE 1 corresponds to thephysical user input detected by UE 1 at 905 of FIG. 9. In an example,the turning of UE 1 can be a flip of UE 1 by its user that isdeliberately made to change the orientation at UE 2. Alternatively, theturning of UE 1 can simply arise as a result of UE 1's user preferring adifferent orientation on his/her own phone. As shown in state 1010, thesmiley face offset 90 degrees by virtue of the 90 degree turning of UE1. In another example, however, UE 1 may include logic for adjusting thesmiley face so that the smiley face still appears vertically oriented tothe user of UE 1 even though UE 1 itself is horizontally oriented.

In 910, UE 1 reports the orientation change of UE 1 to prompt theapplication server 170 to adjust the orientation of a graphic beingdisplayed at UE 2. Accordingly, in 915, the application server 170adjusts the orientation at UE 2. In an example, in 915, the applicationserver 170 can modify the graphical media being streamed to UE 2 by 90degrees to implement the orientation adjustment for UE 2. In analternative example, in 915, the application server 170 can sendunmodified graphical media to UE 2 (if necessary) and can simply sendcontrol commands to UE 2 to instruct UE 2 to offset its orientation forthe graphical media by 90 degrees (clockwise).

After the adjustment at 920, UE 2's state is shown in 1015. Thus, instate 1015, UE 2 is vertically oriented and the smiley face has beentransitioned 90 degrees (clockwise) with a horizontal orientation. Whilenot shown in FIG. 10 explicitly, the orientation transition can occur toencourage the user of UE 2 to engage in the communication session inlandscape mode instead of portrait mode. Thus, while state 1015 shows UE2 with a vertical orientation, the user of UE 2 may be likely to alterUE 2's orientation to conform to the smiley face orientation.

While not illustrated in FIGS. 9 and/or 10, it is possible that certaintarget UEs may lack the ability to implement the display settingadjustment requested by the user of UE 1 via his/her physical userinput. For example, some target UEs may not be able to adjust theirdisplay settings (e.g., rotate display orientation), therefore theapplication server 170 will not adjust the display settings for thesetarget UEs.

Those of skill in the art will appreciate that information and signalsmay be represented using any of a variety of different technologies andtechniques. For example, data, instructions, commands, information,signals, bits, symbols, and chips that may be referenced throughout theabove description may be represented by voltages, currents,electromagnetic waves, magnetic fields or particles, optical fields orparticles, or any combination thereof.

Further, those of skill in the art will appreciate that the variousillustrative logical blocks, modules, circuits, and algorithm stepsdescribed in connection with the embodiments disclosed herein may beimplemented as electronic hardware, computer software, or combinationsof both. To clearly illustrate this interchangeability of hardware andsoftware, various illustrative components, blocks, modules, circuits,and steps have been described above generally in terms of theirfunctionality. Whether such functionality is implemented as hardware orsoftware depends upon the particular application and design constraintsimposed on the overall system. Skilled artisans may implement thedescribed functionality in varying ways for each particular application,but such implementation decisions should not be interpreted as causing adeparture from the scope of the present invention.

The various illustrative logical blocks, modules, and circuits describedin connection with the embodiments disclosed herein may be implementedor performed with a general purpose processor, a digital signalprocessor (DSP), an application specific integrated circuit (ASIC), afield programmable gate array (FPGA) or other programmable logic device,discrete gate or transistor logic, discrete hardware components, or anycombination thereof designed to perform the functions described herein.A general purpose processor may be a microprocessor, but in thealternative, the processor may be any conventional processor,controller, microcontroller, or state machine. A processor may also beimplemented as a combination of computing devices, e.g., a combinationof a DSP and a microprocessor, a plurality of microprocessors, one ormore microprocessors in conjunction with a DSP core, or any other suchconfiguration.

The methods, sequences and/or algorithms described in connection withthe embodiments disclosed herein may be embodied directly in hardware,in a software module executed by a processor, or in a combination of thetwo. A software module may reside in RAM memory, flash memory, ROMmemory, EPROM memory, EEPROM memory, registers, hard disk, a removabledisk, a CD-ROM, or any other form of storage medium known in the art. Anexemplary storage medium is coupled to the processor such that theprocessor can read information from, and write information to, thestorage medium. In the alternative, the storage medium may be integralto the processor. The processor and the storage medium may reside in anASIC. The ASIC may reside in a user terminal (e.g., UE). In thealternative, the processor and the storage medium may reside as discretecomponents in a user terminal.

In one or more exemplary embodiments, the functions described may beimplemented in hardware, software, firmware, or any combination thereof.If implemented in software, the functions may be stored on ortransmitted over as one or more instructions or code on acomputer-readable medium. Computer-readable media includes both computerstorage media and communication media including any medium thatfacilitates transfer of a computer program from one place to another. Astorage media may be any available media that can be accessed by acomputer. By way of example, and not limitation, such computer-readablemedia can comprise RAM, ROM, EEPROM, CD-ROM or other optical diskstorage, magnetic disk storage or other magnetic storage devices, or anyother medium that can be used to carry or store desired program code inthe form of instructions or data structures and that can be accessed bya computer. Also, any connection is properly termed a computer-readablemedium. For example, if the software is transmitted from a website,server, or other remote source using a coaxial cable, fiber optic cable,twisted pair, digital subscriber line (DSL), or wireless technologiessuch as infrared, radio, and microwave, then the coaxial cable, fiberoptic cable, twisted pair, DSL, or wireless technologies such asinfrared, radio, and microwave are included in the definition of medium.Disk and disc, as used herein, includes compact disc (CD), laser disc,optical disc, digital versatile disc (DVD), floppy disk and blu-ray discwhere disks usually reproduce data magnetically, while discs reproducedata optically with lasers. Combinations of the above should also beincluded within the scope of computer-readable media.

While the foregoing disclosure shows illustrative embodiments of theinvention, it should be noted that various changes and modificationscould be made herein without departing from the scope of the inventionas defined by the appended claims. The functions, steps and/or actionsof the method claims in accordance with the embodiments of the inventiondescribed herein need not be performed in any particular order.Furthermore, although elements of the invention may be described orclaimed in the singular, the plural is contemplated unless limitation tothe singular is explicitly stated.

What is claimed is:
 1. A method of operating an application serverconfigured to arbitrate a communication session between a plurality ofuser equipments (UEs), comprising: receiving, from a given UE, data thatis configured to visually represent physical user input that is detectedat the given UE at a first level of precision; determining datapresentation capabilities of at least one target UE and/or a performancelevel associated with a connection between the application server andthe at least one target UE; selectively transitioning the received datafrom the first level of precision to a second level of precision basedon the determination; and transmitting the selectively transitioned datato the at least one target UE for presentation.
 2. The method of claim1, wherein the at least one target UE includes more than one UE.
 3. Themethod of claim 1, wherein the selectively transitioning step does nottransition the received data for a given target UE among the at leastone target UE if the determining step determines that the given targetUE's data presentation capabilities and/or connection performance levelare above a threshold.
 4. The method of claim 1, wherein the selectivelytransitioning step transitions the received data for a given target UEamong the at least one target UE if the determining step determines thatthe given target UE's data presentation capabilities and/or connectionperformance level are below a threshold.
 5. The method of claim 1,wherein the transmitting step: transmits the received data at the secondlevel or precision to a first set of target UEs.
 6. The method of claim5, further comprising: transmitting the received data at the first levelof precision to a second set of target UEs.
 7. The method of claim 5,further comprising: transmitting the received data at a third level ofprecision to a second set of target UEs, the third level of precisionbeing an intermediate level of precision between the first and secondlevels of precision.
 8. The method of 1, further comprising: adjusting aparticipation level of the second UE in the communication session basedon the determination.
 9. The method of claim 8, wherein the adjustingstep transitions the at least one target UE from full-duplex tohalf-duplex.
 10. The method of claim 1, wherein the received data at thesecond level of precision corresponds to a simplified or reduced versionof the received data at the first level of precision.
 11. The method ofclaim 10, wherein the received data at the second level of precisionincludes fewer data points than the received data at the first level ofprecision.
 12. The method of claim 1, wherein the determined datapresentation capabilities of the at least one target UE include adisplay size, resolution, frame rate, display resolution, aspect ratio,processor speed, memory capacity, type of memory, clock frequency,battery life and/or power conservation requirements.
 13. The method ofclaim 1, wherein the determined performance level associated with theconnection is based in-call performance metrics and/or a type of servingnetwork of the at least one target UE.
 14. The method of claim 13,wherein the in-call performance metrics include packet loss and/or roundtrip delay.
 15. A method of operating an application server configuredto arbitrate a communication session between a plurality of userequipments (UEs), comprising: receiving, from a given UE among theplurality of UEs, a request to adjust display settings of at least onetarget UE during the communication session, the request issued from thegiven UE responsive to detection of a physical user input by a user atthe given UE; and selectively adjusting the at least one target UE'sdisplay settings based on the received request.
 16. The method of claim15, wherein the physical user input prompts a display setting adjustmentat the given UE that is analogous to the corresponding displayadjustment for the at least one target UE.
 17. The method of claim 16,wherein the physical user input corresponds to the user of the given UEchanging an orientation of the given UE, and wherein the selectivelyadjusting step (i) transitions an orientation of graphical mediatransmitted to the at least one target UE for presentation thereon inconjunction with the communication session, or (ii) sends controlmessaging to the at least one target UE to prompt the at least onetarget UE to transition the orientation of non-transitioned graphicalmedia presented thereon in conjunction with the communication session.18. The method of claim 16, wherein the physical user input correspondsto the user of the given UE shaking the given UE, and wherein theselectively adjusting step (i) shakes or rattles graphical mediatransmitted to the at least one target UE for presentation thereon inconjunction with the communication session, or (ii) sends controlmessaging to the at least one target UE to prompt the at least onetarget UE to shake or rattle non-transitioned graphical media presentedthereon in conjunction with the communication session.
 19. The method ofclaim 15, wherein the physical user input does not prompt a displaysetting adjustment at the given UE that is analogous to thecorresponding display adjustment for the at least one target UE.
 20. Themethod of claim 19, wherein the physical user input corresponds to theuser of the given UE tapping a portion of the given UE a thresholdnumber of times, wherein the selectively adjusting step (i) modifies acolor scheme applied to graphical media transmitted to the at least onetarget UE for presentation thereon in conjunction with the communicationsession, or (ii) sends control messaging to the at least one target UEto prompt the at least one target UE to modify a color scheme applied tonon-transitioned graphical media presented thereon in conjunction withthe communication session.
 21. The method of claim 15, wherein the atleast one target UE includes more than one UE.
 22. An application serverconfigured to arbitrate a communication session between a plurality ofuser equipments (UEs), comprising: means for receiving, from a given UE,data that is configured to visually represent physical user input thatis detected at the given UE at a first level of precision; means fordetermining data presentation capabilities of at least one target UEand/or a performance level associated with a connection between theapplication server and the at least one target UE; means for selectivelytransitioning the received data from the first level of precision to asecond level of precision based on the determination; and means fortransmitting the selectively transitioned data to the at least onetarget UE for presentation.
 23. An application server configured toarbitrate a communication session between a plurality of user equipments(UEs), comprising: means for receiving, from a given UE among theplurality of UEs, a request to adjust display settings of at least onetarget UE during the communication session, the request issued from thegiven UE responsive to detection of a physical user input by a user atthe given UE; and means for selectively adjusting the at least onetarget UE's display settings based on the received request.
 24. Anapplication server configured to arbitrate a communication sessionbetween a plurality of user equipments (UEs), comprising: logicconfigured to receive, from a given UE, data that is configured tovisually represent physical user input that is detected at the given UEat a first level of precision; logic configured to determine datapresentation capabilities of at least one target UE and/or a performancelevel associated with a connection between the application server andthe at least one target UE; logic configured to selectively transitionthe received data from the first level of precision to a second level ofprecision based on the determination; and logic configured to transmitthe selectively transitioned data to the at least one target UE forpresentation.
 25. An application server configured to arbitrate acommunication session between a plurality of user equipments (UEs),comprising: logic configured to receive, from a given UE among theplurality of UEs, a request to adjust display settings of at least onetarget UE during the communication session, the request issued from thegiven UE responsive to detection of a physical user input by a user atthe given UE; and logic configured to selectively adjust the at leastone target UE's display settings based on the received request.
 26. Anon-transitory computer-readable medium containing instructions storedthereon, which, when executed by an application server configured toarbitrate a communication session between a plurality of user equipments(UEs), cause the application server to perform operations, theinstructions comprising: program code to receive, from a given UE, datathat is configured to visually represent physical user input that isdetected at the given UE at a first level of precision; program code todetermine data presentation capabilities of at least one target UEand/or a performance level associated with a connection between theapplication server and the at least one target UE; program code toselectively transition the received data from the first level ofprecision to a second level of precision based on the determination; andprogram code to transmit the selectively transitioned data to the atleast one target UE for presentation.
 27. A non-transitorycomputer-readable medium containing instructions stored thereon, which,when executed by an application server configured to arbitrate acommunication session between a plurality of user equipments (UEs),cause the application server to perform operations, the instructionscomprising: program code to receive, from a given UE among the pluralityof UEs, a request to adjust display settings of at least one target UEduring the communication session, the request issued from the given UEresponsive to detection of a physical user input by a user at the givenUE; and program code to selectively adjust the at least one target UE'sdisplay settings based on the received request.